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BACKGROUND OF THE INVENTION 



1 . Field of the Invention 

The present invention relates to a medical robotic 
system. 

5 2 . Background Information 

Historically, surgery has been performed by making 
large incisions in a patient to provide access to the 
surgical site. There has been developed instruments that 
;2 allow a surgeon to perform a procedure through small 
hQ incisions in the patient. The instruments include an 
^ endoscope which has a camera that allows the surgeon to 
U view the internal organs of- the patient through a small 
U incision. Such procedures are less traumatic to the 

in 

patient and have shorter recovery times than conventional 

15 surgical procedures. 

Such instruments have even been used to perform 
minimally invasive heart surgery. Blockage of a coronary 
artery may deprive the heart of blood and oxygen required 
to sustain life. The blockage may be removed with 

20 medication or by an angioplasty. For severe blockage a 

coronary artery bypass graft (CABG) is performed to bypass 

Atty Docket No. 155695-0238 -2- BJY/wrj 

Express Mail Label No. EL922431086US 

469027 



the blocked area of the artery. CABG procedures are 
typically performed by splitting the sternum and pulling 
open the chest cavity to provide access to the heart. An 
incision is made in the artery adjacent to the blocked 
5 area. The internal mammary artery is then severed and 
attached to the artery at the point of incision. The 
internal mammary artery bypasses the blocked area of the 
artery to again provide a full flow of blood to the heart. 
1^ Splitting the sternum and opening the chest cavity can 
ii create a tremendous trauma to the patient. Additionally, 

iii 

!l the cracked sternum prolongs the recovery period of the 
patient . 

[■^ Computer Motion of Goleta, California provides a system 

r ~ 

111 under the trademark ZEUS that allows a surgeon to perform 
oft minimally invasive surgery, including CABG procedures. The 
procedure is performed with instruments that are inserted 
through small incisions in the patient's chest. The 
instruments are controlled by robotic arms. Movement of 
the robotic arms and actuation of instrument end effectors 
20 are controlled by the surgeon through a pair of handles and 
a foot pedal that are coupled to an electronic controller. 
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Alternatively, the surgeon can control the movement of an 
endoscope used to view the internal organs of the patient 
through voice commands. 

The handles and a screen are typically integrated into 
5 a console that is operated by the surgeon to control the 
various robotic arms and medical instriiments of a ZEUS 
system. Utilizing a robotic system to perform surgery 
requires a certain amount of training. It would be 
desirable to provide a system that would allow a second 

1.3 

surgeon to assist another surgeon in controlling a robotic 
^4 medical system. The second surgeon could both teach and 

assist a surgeon learning to perform a medical procedure 

with a ZEUS system. This would greatly reduce the time 
ifl required to learn .the operation of a robotically assisted 

medical system. 

U.S. Patent No. 5,217,003 issued to Wilk discloses a 
surgical system which allows a surgeon to remotely operate 
robotically controlled medical instruments through a 
telecommunication link. The Wilk system only allows for 
20 one surgeon to operate the robotic arms at a given time. 

Wilk does not disclose or contemplate a system which allows 
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two different surgeons to operate the same set of robotic 
arms. 

U.S. Patent No. 5,609,560 issued to Ichikawa et al . and 
assigned to Olympus Optical Co. Ltd. discloses a system 
that allows an operator to control a plurality of different 
medical devices through a single interface. The Olympus 
patent does not disclose a system which allows multiple 
surgeons to simultaneously perform a surgical procedure. 
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BRIEF SUMMARY OF THE INVENTION 
A medical system that includes a first input device 
that can move a first input distance to move a first 
medical device and a second input device that can move a 
second input distance to move said first medical device. 
The system may further have a feedback device that can 
provide an indication of a difference between the first and 
second input distances . 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a perspective view of a medical robotic 
system; 

Figure 2 is a perspective view of a control unit; 
5 Figure 3 is a perspective view of a handle assembly of 

the control unit; 

Figure 4 is a perspective view of a handle/wrist 
subassembly; 

Figure 5 is a sectional perspective view of the 
13) handle/wrist subassembly; 

in 

' Figure 6 is an exploded side view of an instrument of 
in the robotic system; 

13 Figure 7 is an illustration of a network system; 

Figure 8 is an illustration of a "surgeon" side of the 

Cm 
C3 

hp network system; 

Figure 9 is an illustration of a "patient" side of the 
network system; 

Figure 10 is a schematic showing various fields of a 
packet transmitted across a communication network; 
20 Figure 11 is an illustration showing an al ternate 

embodiment of the network system; 
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Figure 12 is a schematic of a control system; 

Figure 13 is an illustration depicting collaboration 
between a mentor and pupil controlling a single degree of 
freedom instrument . 

5 



□ 
□ 

in 



ly 
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DETAILED DESCRIPTION 

Referring to the drawings more particularly by 
reference numbers, Figure 1 shows a system 10 that can 
perform minimally invasive surgery. In one embodiment, the 
5 system 10 is used to perform a minimally invasive coronary 
artery bypass graft (MI-CABG) and other anas tomos tic 
procedures. Although a MI-CABG procedure is shown and 
described, it is to be understood that the system may be 
Q used for other surgical procedures. For example, the system 
M can be used to suture any pair of vessels. The system 10 



h 



can be used to perform a procedure on a patient 12 that is 
typically lying on an operating table 14. Mounted to the 



operating table 14 is a first articulate arm 16, a second 
1^ articulate arm 22 and a fifth articulate arm 24 which may 



articulate arm 18, a third articulate arm 20, a fourth 



also be referred to as medical devices. The articulate 
arms 16, 18, 20, 22 and 24 are preferably mounted to the 
table 14 so that the arms are at a same reference plane as 
the patient. Although five articulate arms are shown and 
20 described, it is to be understood that the system may have 
any number of arms . 
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The first 16, second 18, third 20 and fourth 22 
articulate arms may each have .a surgical instriament 26, 28, 
30 and 32, respectively, coupled to robotic arms 34, 36, 38 
and 40, respectively. The fifth articulate arm 24 includes 
5 a robotic arm 42 that holds and moves an endoscope 44. The 
instruments 26, 28, 30 and 32, and endoscope 44 are 
inserted through incisions cut into the skin of the patient 
12. The endoscope 44 has a camera 46 that is coupled to 

|i video consoles 48 which display images of the internal 

*** 

ttO organs of the patient. 

in 

•lI The system 10 may include a mentor control unit (MCU) 

50 and a pupil control unit (PCU) 52. Each control unit 50 
and 52 has a controller 54 and a pair of handle assemblies 

in 56 that allow a mentor surgeon at the MCU 50 to teach and 

te assist a pupil surgeon at the PCU 52. The PCU 52 is 

typically in the operating room. The MCU 50 may be at a 
remote location. Each controller 54 contains electrical 
circuits, such as a processor (s) , memory, I/O interface, 
drivers, etc. that control the movement and actuation of 

20 robotic arms 34, 36, 38, 40 and 42 and instruments 26, 28, 
30 and 32. The surgeon can view a different portion of the 
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patient by providing a voice command (s) that moves the arm 
42 holding the endoscope 44. The robotic arm(s) may be 
devices that are sold by the assignee of the present 
invention. Computer Motion, Inc. of Goleta, California, 
5 under the trademark AESOP. The system is also described in 
U.S. Patent No. 5,657,429 issued to Wang et al . and 
assigned to Computer Motion, which is hereby incorporated 
by reference. 

Any two instruments 26, 28, 30 or 32 can be controlled 



by the handle assemblies 56 of each control unit 50 and 52. 

u 

"4 For example, instruments 26 and 28 can be controlled by the 
handle assemblies 56 of the MCU 50 and instrxaments 30 and 

5 

l2 • 32 can be controlled by the handle assemblies of the PCU 
Cri 52. Alternatively, a single instrument may be controlled 
by handle assemblies 56 of both the MCU 50 and PCU 52. 



The handle assemblies 56 and articulate arms 16, 18, 20 
and 22 have a master-slave relationship so that movement of 
the handles 56 produces a corresponding movement of the 
surgical instruments 26, 28, 30 and/or 32. The controller 
20 54 receives input signals from the handle assemblies 56 of 
each control unit 50 and 52, computes a corresponding 
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movement of the surgical instruments 26, 28, 30 and 32, and 
provides output signals to move the robotic arms 34, 36, 38 
and 40 and instruments 26, 28, 30 and 32. The entire 
system may be similar to a product marketed by Computer 
5 Motion under the trademark ZEUS. The operation of the 
system is also described in U.S. Patent No. 5,762,458 
issued to Wang et al. and assigned to Computer Motion, 
which is hereby incorporated by reference. 
1^ Figure 2 shows a control unit 50 or 52 . The handle 

if assemblies 56 are located adjacent to a surgeon's chair 58. 

in 

The handle assemblies 56 are coupled to the controller 54. 
The controller 54 is coupled to the robotic arms 34, 36, 

~ 38, 40 and 42 and medical instriaments 26, 28, 30 and 32. 

\^ The controller 54 may include one or more microprocessors, 
memory devices, drivers, etc. that convert input 
information from the handle assemblies 56 into output 
control signals which move the robotic arms. 34, 36, 38 and 
40 and/or actuate the medical instrxaments 26, 28, 30 and 
32. 

20 The surgeon's chair 58 and handle assemblies 56 may be 

in front of the video console 48. The video console 48 may 
be linked to the endoscope 44 shown in Figure 1 to provide 
video images of the patient. The control unit 50 or 52 may 
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also include a computer screen 60 coupled to the controller 
> 54. The screen 60 may display graphical user interfaces 
(GUIs) that allow the surgeon to control various functions 
and parameters of the system 10. The control unit 50 or 52 
5 may further have a microphone (not shown) to accept voice 
commands. One or more voice commands may be used to move 
the endoscope- Other voice commands can be used to vary 
parameters of the system. The voice control and parameter 
changing system may be the same or similar to a product 
10 sold by Computer Motion under the trademark HERMES. 

Each handle assembly 56 may include a handle /wrist 
assembly 62. The handle/wrist assembly 62 has a handle 64 
that is coupled to a wrist 66. The wrist 66 is connected 
to a forearm linkage 68 that slides along a slide bar 70. 



□ 

a 
m 



m 

i 

pSs The slide bar 70 is pivotally connected to an elbow joint 

u 

In 72. The elbow joint 70 is pivotally connected to a 

ii shoulder joint 74 that is attached to the controller 54. 

Figure 3 shows a handle assembly 56 superimposed with a 

medical instrument" 26, 28, 30 or 32. The instrument 26, 
20 28, 30 or 32 may include an end effector 76 attached to an 

instrument shaft 77. The shaft 77 extends through a 

cannula 78 inserted through an incision of a patient 12. 

The incision defines a pivot point P for the medical 

instrument 26, 28, 30 or 32. 
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The shoulder joint 74 includes a sensor (not shovm) 
that provides feedback on the movement of the handle 64 
about a shoulder axis 76. The sensor may be a mechanical 
encoder, optical encoder, etc. or other device which 
provides an output signal that corresponds to a position of 
the handle 64 about the shoulder axis 76. The output of 
the shoulder sensor is provided to the controller 54. The 
controller .54 performs a series of computations to 
determine a corresponding movement of the medical 
10 instrument 26, 28, 30 or 32. The computations may include 
one or more transformation and kinematic equations. The 
controller 54 provides output signals to the corresponding 
robotic arm to move the instrument 26, 28, 30 or 32 as 
indicated by the arrow 79. The transformation and 
i6 kinematic equations may be similar to the equations used m 
(R the AESOP and ZEUS products with the signs (+/-) reversed 
fU to account for the elbow axis 76 being behind the surgeon. 

The shoulder joint 74 may have a force actuator (not 
shown) that can provide a resistive force to movement of 
20 the handle 64 about the axis 76. The force actuator may be 
an active device or a passive device such as a friction 
clutch. 

The elbow joint 72 includes a sensor (not shown) that 
provides positional feedback on the position of the 
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assembly about an elbow axis 80. The controller 54 
utilizes the positional feedback to drive the robotic arm 
and move the instrument in the direction indicated by the 
arrow 82 . 

The elbow joint 72 may also have a force actuator (not 
- shown) that can provide resistance to movement of the 
handle about the axis 80. When transforming movement of 
the handle 64 to movement of the instrument 26, 28, 30 or 
32 the controller 54 may equate the elbow axis 80 to the 
instrument pivot point P. Equating the elbow axis 80 with 
the pivot point P provides a kinematic relationship such 
that the surgeon "feels" like they are actually moving the 
instrument. Additionally, the length of the forearm 
linkage and location of the handle are such that the 
surgeon is provided with the sensation that they are 
holding and moving the distal end of the instrument. These 
relationships also improve the ergonomics of the handle 
assembly and the ease of use of the robotic system as a 
whole. 

The forearm linkage 68 and slide bar 70 create a 
translator 84 that allows linear movement of the linkage 68 
along a translator axis 86. The translator 84 has a sensor 
(not shown) that provides feedback information that is used 
to drive the robotic arm and move the instrument 26, 28, 30 
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or 32 in the direction indicated by the arrows 88. The 
translator 84 may also have a force actuator (not shown) 
that can provide resistance to movement along axis 86. 

Figures 4 and 5 show the wrist/handle assembly 62. The 
5 wrist 66 includes a joint shaft 90 that is coupled to the 
forearm linkage (not shown) by a roll bearing 92. The roll 
bearing 92 allows the handle 64 to rotate about a roll axis 
94. The wrist 66 may further include a sensor 96 that 
provides positional feedback to the controller 54. 
10 Movement of the handle 64 about the roll axis 94 may cause 
'f% a corresponding rotation of the instrument end effector 76 
u in the direction indicated by the arrows 98 in Fig. 3. The 
wrist 66 may have a force actuator (not shown) that 

m 

s provides resistance to movement of the handle 64 about the 

?** 

hid 

IS wrist axis 94. 

Sh The handle 64 includes a grasper 100 that is coupled to 

fU a handle housing 102. The housing 102 and grasper 100 are 
preferably shaped as an ellipsoid to allow the user to more 
easily grasp the handle 64 with their hand. The housing 
20 102 may have a thumb groove 104 that receives the user's 
thumb. The grasper 100 may have a pair of grooves 106 and 
108 to receive the index and middle fingers of the user, 
respectively. 
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The handle 64 may spin about wrist axis 110. The 
handle 64 may include a sensor 112 that provides positional 
feedback information to the controller 54 which is used to 
rotate the end effector 76 of the medical instrument 26, 
5 28, 30 or 32 as indicated by the arrows 114 in Fig. 3. The 
handle 64 may also have a force actuator (not shown) that 
may provide resistance to rotation about axis. 

The grasper 100 can be depressed by the user. The 
grasper 100 is coupled to a sensor 116 which provides 
10 feedback information to the controller 54. The feedback 

information is used by the controller 54 to actuate the end 
effector 76 shown in Fig. 3. By way of example, depressing 
the grasper 100 may close the end effector 76. The grasper 
100 may include a switch 118 that allows the user to lock 
is the position of the grasper 100 and the end effector 76 of 
the corresponding medical instrument. The locking switch 
118 may be coupled to a ratchet (not shown) that allows the 
grasper 100 and corresponding end effector 7 6 to be locked 
at one of a number of positions. The handle 64 may also 
20 have a force actuator (not shown) that provides resistance 
to movement of the grasper 100. 

The handle 64 have a plurality of buttons 120, 122 and 
124 that can be depressed by the user. By way of example, 
button 120 may be used to activate a cutting mode on a 
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cauterizing end effector. Button 122 may be used to 
activate a coagulating medical instrument. The button 124 
may be used to vary different functions of the system. 



Figure 6 shows one of the surgicaljij26 , 28, 30 or 
The instrument 26, 28, 30 or 32 may include the efid 
effector 76 that is coupled to an actuator rda 126 located 
within the instrument shaft 77. The acfeuator rod 126 is 
coupled to a motor 130 by an adapter 132. The motor 130 
actuates the end effector 76 bj/moving the actuator rod 
126. The actuator rod 126y4^ coupled to a force sensor 134 
that can sense the force being applied by the end effector 
76. The force senspr 134 provides an analog output signal 
that is sent to >a controller 54 shown in Fig. 1. 
Additionallyythe instrument 26, 28, 30, 32 may allow 
movement along the arrows 114 and have a force sensor (not 
shown) yto sense force in this direction. Each joint of the 
robotic arms 34, 36, 38 and 40 may also have force sensor 
that provide^ feedback to the controller 54. 

The adapter 132 may be coupled to a gear assembly 136 
located at the end of a robotic arm 34, 36, 38 or 40. The 
gear assembly 136 can rotate the adapter 132 and end 
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effector 76. The actuator rod 126 and end effector 76 may 
be coupled to the force sensor 134 and motor 130 by a 
spring biased lever 138. The instrument 26, 28, 30 or 32 
may be the same or similar to an instrument described in 
5 the M58 patent. 

Figure 7 depicts the MCU 50 and PCU 52 coupled to the 
articulate arms 16, 18, 20, 22 and 28 by a network port 140 
and a pair of interconnect devices 142 and 144. The 
network port 140 may be a computer that contains the 
necessary hardware and software to transmit and receive 
information through a communication link 146 in a 
communication network 148. 

The control units 50 and 52 may provide output signals 
and commands that are incompatible with a computer. The 
Ite interconnect devices 142 and 144 may provide an interface 
that conditions the signals for transmitting and receiving 
signals between the control units 50 and 52 and the network 
computer 140. 

It is to be understood that the computer 140 and/ or 
20 control units 50 and 52 may be constructed so that the 
system does not require the interconnect devices 142 and 
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144. Additionally, the control units 50 and 52 may be 
constructed so that the system does not require a separate 
networking computer 140. For example, the control units 50 
and 52 may be constructed and/or configured to directly 
transmit information through the communication network 148, 

The system 10 may include a second network port 150 
that is coupled to a robot/device controller (s) 152 and the 
communication network 148. The device controller 152 
controls the articulate arms 16, 18, 20, 22 and 24. The 



id second network port 150 may be a computer that is coupled 

m 

f"^ to the controller 152 by an interconnect device 154. 

"5:3 



Jj^ Although an interconnect device 154 and network computer 
13 150 are shown and described, it is to be understood that 

the controller 152 can be constructed and configured to 
J| eliminate the device 154 and/or computer 150. 

The communication network 148 may be any type of 
communication system including but not limited to, the 
internet and other types of wide area networks (WANs) , 
intranets, local area networks (LANs), public switched 
20 telephone networks (PSTN), integrated services digital 
networks (ISDN) . It is preferable to establish a 
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communication link through a fiber optic network to reduce 
latency in the system. Depending upon the type of 
communication link selected, by way of example, the 
information can be transmitted in accordance with the user 
5 datagram protocol /internet protocol (UDP/IP) or 

asynchronous transfer mode/ATM Adaptation Layer 1(ATM/AAL1) 
network protocols. The computers 140 and 150 may operate 
in accordance with an operating system sold under the 
U designation VxWorks by Wind River. By way of example, the 

b 

12) computers 140 and 150 may be constructed and configured to 

in 

l^, operate with 100-base T Ethernet and/or 155 Mbps fiber ATM 
tj\ systems . 

5 

i3 Figure 8 shows an embodiment of a mentor control unit 

50. The control unit 50 may be accompanied by a 

O 

|L5 touchscreen computer 156 and an endoscope interface 

computer 158. The touchscreen computer 156 may be a device 
sold by Computer Motion under the trademark HERMES. The 
touchscreen 156 allows the surgeon to control and vary 
different functions and operations of the instruments 26, 

20 28, 30 and 32. For example, the surgeon may vary the scale 
between movement of the handle assemblies 56 and movement 
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of the instruments 26, 28, 30 and 32 through a graphical 
user interface (GUI) of the touchscreen 156. The 
touchscreen 156 may have another GUI that allows the 
surgeon to initiate an action such as closing the gripper 
5 of an instrument. 

The endoscope computer 158 may allow the surgeon to 
control the movement of the robotic arm 42 and the 
endoscope 44 shown in Fig. 1. Alternatively, the surgeon 
can control the endoscope through a foot pedal (not shown) . 
1% The endoscope computer 158 may. be a device sold by Computer 

m 

Motion under the trademark SOCRATES. The touchscreen 156 

m 



and endoscope computers 158 may be coupled to the network 



Q computer 140 by RS232 interfaces or other serial 

u 

t*^ interfaces. 

in 



A ZEUS control unit 50 will transmit and receive 
information that is communicated as analog, digital or 
quadrature signals. The network computer 140 may have 
analog input/output (I/O) 160, digital I/O 162 and 
quadrature 164 interfaces that allow communication between 
20 the control unit 50 and the network 148. By way of 
example, the analog interface 160 may transceive data 
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relating to handle position, tilt position, in/out position 
and foot pedal information (if used) . The quadrature 
signals may relate to roll and pan position data. The 
digital I/O interface 162 may relate to cable wire sensing 
data, handle buttons, illuminators (LEDs) and audio 
feedback (buzzers) . 

The position data. is preferably absolute position 
information. By using absolute position information the 
robotic arms can still be moved even when some information 
is not successfully transmitted across the network 148. If 
incremental position information is provided, an error in 
the transmission would create a gap in the data and 
possibly inaccurate arm movement. The network computer 140 
may further have a screen and input device (e.g. keyboard) 
166 that allows for a user to operate the computer 140. 

Figure 9 shows an embodiment of a patient side network 
and control computer. The controller 152 may include three 
separate controllers 168, 170 and 172. The controller 168 
may receive input commands, perform kinematic computations 
based on the commands, and drive output signals to move the 
robotic arms 34, 36, 38 and 40 and accompanying instruments 
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26, 28, 30 and 32 to a desired position. The controller 
170 may receive commands that are processed to both move 
and actuate the instruments. Controller 172 may receive 
input commands, perform kinematic computations based on the 
commands, and drive output signals to move the robotic arm 
42 and accompanying endoscope 44. 

Controllers 168 and 170 may be coupled to the network 
computer by digital I/O 176 and analog I/O 174 interfaces. 
The computer 150 may be coupled to the controller 172 by an 
RS232 interface or other serial type interfaces. 
Additionally, the computer 150 may be coupled to 
corresponding RS232 ports or other serial ports of the 
controllers 168 and 170. The RS232 ports or other serial 
ports of the controllers 168 and 170 may receive data such 
as movement scaling and end effector actuation. 

The robotic arms and instruments contain sen^jWPsT 
encoders, etc. that provide f eedbackiafSrination including 
force and position data.^^Spm^or all of this feedback 
information may be^t^tTansmitted over the network 148 to the 
surgeon sid^-'^ the system. By way of example, the analog 
feedj)a:^ information may include handle feedback, tilt 
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feedback, in/out feedback and foot^^^^dal feedback. Digital 
f^feedback may include cable sejasing, buttons, illumination 
and auditory feedback. TKe computer 150 may be coupled to 
a screen and input device (e.g. keyboard) 178. 

Referring to Figure 7, the computers 140 and 150 may 
packetize the information for transmission through the 
communication network 148. Each packet will contain two 
types of data, robotic data and other needed non-robotic 
data. Robotic data may include position information of .the 
robots, including input commands to move the robots and 

m 

position feedback from the robots. Other data may include 



It 



functioning data such as instrument scaling and actuation. 



13 Because the system transmits absolute position data the 

packets of robotic data can be received out of sequence. 

& This may occur when using a UDP/IP protocol which uses a 
best efforts methodology. The computers 140 and 150 are 
constructed and configured to properly treat any ^^late" 
arriving packets with robotic data. For example, the 
computer 140 may sequentially transmit packets 1, 2 and 3. 

20 The computer 150 may receive the packets in the order of 1, 
3 and 2. The computer 150 can disregard the second packet 
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2. Disregarding the packet instead of requesting a re- 
transmission of the data reduces the latency of the system. 
It is desirable to minimize latency to create a "real time" 
operation of the system. 

It is preferable to have some information received in 
strict sequential order. Therefore the receiving computer 
will request a re-transmission of such data from the 
transmitting computer if the data is not errorlessly 
received. The data such as motion scaling and instrument 
actuation must be accurately transmitted and processed to 
insure that there is not an inadvertent command. 

The computers 140 and 150 can multiplex the RS232 data 
from the various input sources. The computers 140 and 150 
may have first-in first-out queues (FIFO) for transmitting 
information. Data transmitted between the computer 140 and 
the various components within the surgeon side of the 
system may be communicated through a protocol provided by 
Computer Motion under the name HERMES NETWORK PROTOCOL 
(HNP) . Likewise, information may be transmitted between 
components on the patient side of the system in accordance 
with HNP. 
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In addition to the robotic and non-robotic data, the 
patient side of the system will transmit video data from 
the endoscope camera 46. To reduce latency in the system, 
the video data can be multiplexed with the robotic/other 
data onto the communication network. The video data may be 
compressed using conventional JPEG, etc. compression 
techniques for transmission to the surgeon side of the 
system. 

Each packet may have the fields shown in Figure 10. 
The SOURCE ID field includes identification information of 
the input device or medical device from where the data 
originates. The DESTINATION ID field includes 
identification information identifying the input device or 
medical device that is to receive the data. The OPCODE 
field defines the type of commands being transmitted. 

The PRIORITY field defines the priority of the input 
device. The priority data may be utilized to determine 
which input device has control of the medical device. The 
PRIORITY field may contain data that allows relative shared 
control of a particular instrument. For example, the 
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mentor may have 50% control and the pupil may have 50% 
control , 

The SEQ # field provides a packet sequence niomber so 
that the receiving computer can determine whether the 
5 packet is out of sequence. The TX Rate field is the 

average rate at which packets are being transmitted. The 
RX Rate field is the average rate that, packets are being 
received. The RS232 or serial ACK field includes an 

1^ acknowledgement count for RS232 data. RS232 data is 

b 

is typically maintained within the queue of a computer until 

in 

h an acknowledgement is received from the receiving computer 



rji that the data has been received. 

3 

13 The RS232 POS field is a counter relating to 



transmitted RS232 data. The RS232 ID field is an 
|§ identification for RS232 data. The RS232 MESS SZ field 
contains the size of the packet. The RS232 BUFFER field 
contains the content length of the packet. The DATA field 
contains data being transmitted and may contain separate 
subfields for robotic and RS232 data. CS is a checksum 
20 field used to detect errors in the transmission of the 
packet . 
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Either computer 140 or 150 can be used as an arbitrator 

-^^ 

between the input devices and the medical devices. For 
example, the computer 150 may receive data from both 
control units 50 and 52. The packets of information from 
each control units 50 and 52 may include priority data in 
the PRIORITY fields. The computer 150 will route the data 
to the relevant device (eg. robot, instrument, etc.) in 
accordance with the priority data. For example, control 
unit 50 may have a higher priority than control unit 52. 
The computer will route data to control a robot from 
control unit 50 to the exclusion of data from control unit 
52 so that the surgeon at 50 has control of the arm. 

As an alternate embodiment, the computer 150 may be 
constructed and configured to provide priority according to 
the data in the SOURCE ID field. For example, the computer 
150 may be programmed to always provide priority for data 
that has the source ID from control unit 50. The computer 
150 may have a hierarchical tree that assigns priority for 
a number of different input devices. 

Alternatively, the computer 140 may function as the 
arbitrator, screening the data before transmission across 
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the network 148. The computer 140 may have a priority 
scheme that always awards priority to one of the control 
units 50 or 52. Additionally, or alternatively, one or 
more of the control units 50 and/or 52 may have a 
5 mechanical and/or software switch that can be actuated to 
give the console priority. The switch may function as an 
override feature to allow a surgeon to assume control of a 
procedure . 

In operation, the system initially performs a start-up 

= w 

]i5 routine. The ZEUS system is typically configured to start- 
in 

f"^ up with data from the consoles. The consoles may not be in 
f| communication during the start-up routine of the robotic 
C;3 arms, instruments, etc. therefore the system does not have 
|jj the console data required for system boot. The computer 
l| 150 may automatically drive the missing console input data 
to default values. The default values allow the patient 
side of the system to complete the start-up routine. 
Likewise, the computer 140 may also drive missing incoming 
signals from the patient side of the system to default 
20 values to allow the control units 50 and/or 52 to boot-up. 
Driving missing signals to a default value may be part of a 
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network local mode. The local mode allows one or more 
consoles to "hot plug" into the system without shutting the 
system down. 

Additionally, if communication between the surgeon and 
patient sides of the system are interrupted during 
operation the computer 140 will again force the missing 
data to the last valid or default values as appropriate. 
The default values may be quiescent signal values to 
prevent unsafe operation of the system. The components on 
the patient side will be left at the last known value so 
that the instruments and arms do not move. 

Once the start-up routines have been completed and the 
communication link has been established the surgeons can 
operate the consoles. The system is quite useful for 
medical procedures wherein one of the surgeons is a teacher 
and the other surgeon is a pupil. The arbitration function 
of the system allows the teacher to take control of robot 
movement and instrument actuation at anytime during the 
procedure. This allows the teacher to instruct the pupil 
on the procedure and/or the use of a medical robotic 
system. 
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Additionally, the system may allow one surgeon to 
control one medical device and another surgeon to control 
the other device. For example, one surgeon may move the 
instruments 26, 28, 30 and 32 while the other surgeon moves 
5 the endoscope 44, or one surgeon may move one instrument 
26, 28, 30 or 32 while the other surgeon moves the other 
instrument 26, 28, 30 or 32. Alternatively, one surgeon 
may control one arm(s) , the other surgeon can control the 
other armCs), and both surgeons may jointly control another 
arm. 

Figure 11 shows an alternate embodiment, wherein one or 
more of the control units 50 and 52 has an alternate 

C;^ communication link 180. The alternate link may be a 

I- 

telecommunication network that allows the control unit 50 

m 

iii to be located at a remote location while control unit 52 is 
in relative close proximity to the robotic arms, etc. For 
example, control unit 50 may be connected to a public phone 
network, while control unit 52 is coupled to the controller 
152 by a LAN. Such a system would allow telesurgery with 

20 the robotic arms, instruments, etc. The surgeon and 



|t4 

m 



■t I 

-4 

m 
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patient sides of the system may be coupled to the link 180 
by network computers 182 and 150. 

Figure 12 shows a schematic of a control system 190 to 
allow joint control of a single medical instrument with 
handles from two different control units 50 and 52. The 
control system 190 may include an instrument controller 192 
coupled to a medical instrument 26, 28, 30 and 32, The 
instrument controller 192 minimizes the error between the 
desired position Xdes of the medical instrument 26, 28, 30 or 
32 and the actual position x of the instrument 26, 28, 30 
or 32. 

The instrument controller 192 is coupled to the 
position controllers 194 and 196 for the MCU 50 and PCU 52, 
respectively. The position controllers 194 and 196 are 
each connected to a corresponding handle controller 198 and 
200, respectively, which is coupled to the handles 56 of 
each control unit. The handle controllers 198 and 200 
provide output xi and X2, respectively, that corresponds to 
the movement of the handles 56. The output is transformed 
to position output signals to drive the actuators of the 
medical instrioment 26, 28, 30 or 32. The value of x^es can 
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be computed from Xi and X2 and a proportional control 
variable. 

The instriHTient controller 192 also computes force 
feedback information from the force sensors of the 
5 instrument. The force feedback information is relayed back 
to the handle controllers 198 and 200 and handles 56 to 
provide force feedback to the surgeon. The amount of force 
feedback to each set of handles may depend on the shared 
U control of the mentor 50 and pupil 52 control units. 

a 

1?) Referring to Figure 13, the displacements of the mentor 

111 

and pupil are represented by Xi and X2, respectively. The 



B motion of the instrument is a convex combination of the 
3 motion of the mentor and pupil, namely. 



irrespective of the value of a. When Xi^X2, the deformation 
of the spring at the mentor end is 



ill 
JL5 



x = (l-a) Xi + ax2 



(1) 



The springs in Figure 13 are undeformed when Xi=X2, 



x-xi - a(x2-Xi) 



(2) 



The mentor therfore feels the force 



20 



Fi = Ka(x2-xi) 



(3) 



Where K is the spring constant. 
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At the same time, the deformation of the spring at the 
pupil end is: 

(X2-X) = (l-a) (X2-X1) (4) 
The pupil therefore feels the force: 
F2 = K(l-a) (X2-X1) (5) 
There are typically a set of equations tp^etermine the 
movement x and force feedback Fi and^&f^or each axis of 
each instrument. There may al-^be a set of equations for 
actuation of each en^^^^ff ector . For angular movement the 
distance is tyt^ally computed in degrees, radian(3> some 
othei>^^ngular unit of measure. . 

When the mentor has complete control, a is set to 1 and 
the mentor handles provide no force feedback. The variable 
oc can be set through the computer interfaces of the system 
10. The force fedback to the pupil handles corresponds to 
the position information generated by the mentor handles 
and the position information generated by the pupil 
handles. Thus if the pupil handle movement deviates from 
the mentor handle movement, the system provides force 
feedback to push the pupil into the desired hand movement. 
This is similar to teaching one to write with a pencil by 
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grabbing their hand and moving the pencil. The system thus 
allows the mentor to guide the pupil through the motion of 
using the handles to move the medical instrument and 
perform a medical procedure. This can be a valuable 
instructional guide in learning how to use the system and 
perform robotically assisted minimally invasive procedures. 

The proportional variable a allows the mentor and pupil 
to jointly control the movement of an instrument 26, 28, 30 
and/or 32. The instrument controller 192 can compute the 
Xdes using equation (3). The feedback forces and are 
computed using equations (1) and (2) and fed back to the 
mentor and pupil through the force actuator for each, joint. 

In operation, the users may set the value of a. For 
example, a may be set at .5 for split control. Both the 
mentor and pupil move their handles a distance and x^, 
respectively. There may in fact be multiple movements 
including wrist and roll movement. The controllers compute 
the corresponding movement x from the equation and drive 
the robotic arm to move the instrument. The controllers 
also calculate the forces F, and F^ and drive the force 
actuators for each corresponding joint. If the pupil and 
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mentors movements are in sync then the system does not 
provide force feedback. If the movements are out of sync 
the system provides a force feedback that allows the 
participants to "feel" the discrepancy between their 
5 movement commands. 

While certain exemplary embodiments have been described 
and shown in the accompanying drawings, it is to be 
understood that such embodiments are merely illustrative of 
1*3. and not restrictive on the broad invention, and that this 

a 

tif) invention not be limited to the specific constructions and 
J1 arrangements shown and described, since various other 
111 modifications may occur to those ordinarily skilled in the 
art . 

JjJ Although force feedback is described, it is to be 

13 

pi^5 understood that other means for showing pupil handle 
deviation may be used in the system. For example, the 
system may have a visual indicator such as a bar graph that 
indicates the deviation between the mentor and pupil 
handles . 
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